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PROBLEMS  THAT  MAY  HAVE  LOCAL  MINIMA 

by 

Garth  P.  McCormick 


INTRODUCTION 

A  particularly  vexing  problem  in  the  solution  of  nonlinear 
optimization  problems  is  the  possibility  that  algorithms  for 
solving  the  problem  converge  to  local  as  opposed  to  global  solu¬ 
tions.  In  this  paper  is  contained  an  all  too  brief  survey  of 
proposals  for  obtaining  global  solutions  to  not  necessarily 
convex  optimization  problems.  In  all  cases  an  attempt  will  be 
made  to  point  out  the  difficulties  associated  with  the  ideas. 

CONVEX  PROGRAMMING,  CONVEX  ENVELOPES  AND  THE  GLOBAL  SOLUTION 
It  is  well  known  that  a  local  solution  to  the  problem 

min  f(x)  subject  to  g^(x)  0,  i  “  l,...,m 

where  X'-eEn,  f(x),  {-  g^x)},  are  donvex  functions  is  also  a 
global  solution.  An  Interesting  proposal  for  solving  for  the 
global  solution  when  tne  convaxity  assumptions  do  not  hold  has 
been  proposed  by  Kleibohra  [19].  The  problem  he  addressed  was 
slightly  more  general, 
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given  as 


min  £(x)  subject  to  *eB  where  f  is  continuous, 

B  a  compact  set. 

Define  CON(B)  (the  convex  hull  of  B)  as 

n  n 

CON(B)  =■  {x|x  »  t  X  x. ,  x.eB}  where  X.  ^0,  EX.  ■  1  . 

j=l  J  J  3  J  j“l  ^ 

Define  the  largest  convex  subfunction  u(»)  as 

1.  u(*)  is  convex  on  CON(B) 

2.  u(x)  ^f(x)  for  all  xeB 

3.  u(x)  >_  q(x)  for  all  *eB  for  all  functions  q(*) 
having  the  prope.ties  that 

4.  q(*)  is  convex  on  CON(B) 

5.  q(x)  ^  f(x)  for  all  »cB.  , 

He  proves  the  following  result. 

The  solution  set  of;  min  u(x)  subject  to  x.'eCQN(B) 
contains  the  solution  set  of;  min  f(x)  subject  to  xeB  . 

This  interesting  proposal  has  mucn  theoretical  interest 
anu  points  out  at  least  in  an  nbs tract  geometrical  manner  how 
to  solve  the  problem.  The  difficulties  with  it  are  threeiold. 
The  major  problem  is  that  it  is  impossible,  except  in  certain 
special  cases,  to  describe  algebraically  CON(B)  and  u(*)  . 

In  more  concrete  terms,  one  cannot  implement  the  algorithm  on 
a  digital  computer.  Second,  it  seems  clear  from  some  small 
examples  that  the  function  u(*)  does  not  maintain  the  differ¬ 
entiability  properties  of  the  original  function.  Hence  existing 
algorithms  for  solving  a  convex  program  could  ’  i.  be  >sed. 
Finally,  the  solution  to  the  convex  programming  problem  need  not 
be  feasible  to  the  original  problem,  although  the  solution  values 
are  th,  .note. 
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THE  USE  OF  GRIDS 

*r 

One  of  the  most  obvious  ways  to  solve  a  programming  problem 
and  one  which  is  often  suggested  by  those  new  to  the  field  is  the 
grid  approach.  The  algorithm  assumes  lower  and  upper  bounds  on 
each  variable,  divides  the  resulting  interval  into  1^  equally 
spaced  intervals  and  finds  the  point  over  the  grid  with  minimum 
objective  function  value  which  is  feasible.  The  difficulty  with 
this  approach  is  the  extraordinarily  high  number  of  function 
evaluations  required  for  a  problem  with  many  variables.  The  number 

n 

of  possibilities,  or  combinations  of  points  involved  is  v  I.  .  Many 

j=l  J 

methods  for  obtaining  global  solutions  essentially  are  of  the  grid 
type.  The  branch  and  bound  technique  for  separable  programming 
described  later  has  elements  of  a  grid  search  but  is  intended,  like 
all  branch  and  bound  methods,  to  reduce  the  number  of  points  consid¬ 
ered  by  showing  that  subsets  of  the  combinations  cannot  possibly 
contain  the  solution  to  the  problem.  Recent  work  by  Hartley, 
et  al., [14]  falls  into  the  category  of  a  grid  search  method. 

RANDOM  METHODS 

An  idea  akin  to  the  grid  approach  for  obtaining  global  solu¬ 
tions  is  the  random  method,  and  variations  on  this  method.  Basically 
the  idea  is  to  assume  lower  and  upper  bounds  on  the  range  of  the 
variables  and  generate  points  within  that  range  by  a  randomized 
procedure.  Methods  vary  in  the  way  the  points  are  generated  and 
how  much  use  they  make  of  previous  information.  A  limited  amount 
of  experience  by  the  author's  student  with  the  Russian  approaches, 
Matyas  [22],  Motkus  [25],  showed  evidence  that  the  methods  had  a 
very  slow  rate  of  convergence  and  took  an  enormous  number  of 
function  evaluations.  Theoretically,  of  course,  it  is  possible  to 
show  that  the  methods  converge  in  the  limit  to  the  global  solution 
with  probability  one. 
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THE  LAGRANGIAN  APPROACH 

One  often  heralded  approach  to  the  programming  problem  is 
the  use  of  the  Lagrangian  function  L(x,u)  -  f(x)  -  Eu^Cx)  to 

obtain  global  solutions.  Roughly  stated,  one  generates  a  sequence 

j- 

of  nonnegative  multiplier  vectors  {u  }  and  an  associated  sequence 
h  >  of  points  which  are  the  global  unconstrained  minimizers  of  the 

Lagrangian.  If  the  values  of  {g^(x  )}  tend  to  zero  for  non-zero 

k  k 

u^  limits,  then  limit  points  of  {x  }  are  global  solutions  to  the 

programming  problem.  The  alleged  ease  of  implementing  this  method 
for  separable  problems  has  made  it  attractive.  Several  points  should 
be  noted.  First,  in  the  case  whan  there  are  no  constraints  the 
algorithm  reduces  to  the  tautology  —  '<to  find  the  global  uncon¬ 
strained  minimizer  of  f(x),  find  the  global  unconstrained  minimizer 
of  f(x),‘"  i.e.,  there  is  no  algorithm  in  the  sense  of  a  prescribed 

iterative  procedure  for  doing  this.  Second,  in  general  for  the 
nonconvex  optimization  problem,  the  Lagrange  multipliers  associated 
with  the  global  solution  and  the  solution  point  do  not  constitute  a 
pair  for  which  the  Lagrangian  has  a  global  unconstrained  minimizer 

A 

at  x  .  In  a  nonconvex  problem  the  Lagrangian  is  usually  nonconvex 
and  has  no  unconstrained  minimizer  at  all.  In  the  convex  problem  the 
difficulty  with  the  Lagrangian  approach  is  just  to  find  the  proper 
multipliers.  In  [5]  Falk  has  shown  the  conditions  under  which  such 
an  algorithm  would  work  for  the  convex  case. 

In  another  paper,  Falk  [6]  characterized  the  solution  obtained 
by  the  Lagrangian  approach  to  the  problem  min  f(x)  sub,ect  to  x  >_  b, 
xeG,  where  G  is  a  compact  convex  set  as  the  solution  to  the 
minimization  of  c(x)  subject  to  Ax  >_ b,  xeG  where  c(x)  is  the 
convex  enveloped  of  f(x)  over  G  .  (Recall  from  the  theorem  of 
Kleibohm  the  minimization  should  be  of  the  convex  envelope  of 
f(x)  over  {GDAx  b}  to  obtain  the  sarj  solution).  For  more 
complicated  problems  the  solution  obtained  is  not  easy  to  cnaracterize 
but  it  is  certainly  not  the  ccrrect  one. 
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Example  1 

To  make  the  point  more  explicitly,  consider  the  problem 
2  2 

minimize  -  x^  -  x2 

subject  to  -  x.^  -  4x2  +  5  >_  0,  -  x^  +  1  ^  0,  x^  >_  0,  x2  >,  0  . 

This  problem  has  two  local  minimizers.  Form  the  Lagrangian  function 
2  2 

L(x,u)  »  -  xx  -  x2  -  u^-  ^  -  4x2  +  5)  -  u2(-  Xj+1)  -  u3(x1)  -  u^(x2) 

Nov  for  no  choice  of  multipliers  does  this  Lagrangian  function 
have  a  finite  unconstrained  minimizer. 

The  second  order  necessary  conditions  characterizing  a  local 
minimizer  to  a  nonconvex  programming  problem  indicate  very  clearly 
that  the  Lagrangian  is  in  some  sense  minimized  (again,  speaking 

A 

roughly)  at  x  only  in  directions  orthogonal  to  the  gradients  of 
the  binding  constraints.  Hence,  basing  a  method  on  finding  the 
unconstrained  minimizer  of  the  Lagrangian  is  doomed  to  fail  since 
it  does  not  take  into  account  the  fundamental  characteristics  which 
apply  to  a  local  (and  hence  global)  minimizer  to  a  nonlinear 
programming  problem. 

THE  PENALTY  FUNCTION  APPROACH 

An  easy  theorem  to  prove  is  that  if  one  applies  an  interior 
point  unconstrained  penalty  function  to  a  nonconvex  programming 
problem,  such  as  that  given  by  (1)  and  (2),  e.g.,  if  one  obtains 

the  global  minimizer  x  of  f(x)  -  r^IJlng^(x)  for  a  decreasing 

sequence  of  values  {r^}  which  tend  to  zero,  then  me  global 
unconstrained  minimizers  approach  the  global  unconstrained  solution 

(xK-+x  )  in  the  limit  as  r  -*•().  Unlike  the  Lagrangian  approach, 
th  tistence  of  the  global  unconstrained  minimizer  in  the  interior 
of  the  feasible  region  usually  obtains  in  the  nonconvex  situation. 

For  example,  if  {xjf(x)  M,  g^Cx)  >_  0,  i  *  1,..  .m}  is 
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Bounded  for  all  M  (which  it  usually  is  in  practice) ,  then  a 
global  minimizer  of  the  penalty  function  exists.  The  difficulty 
here  is  that  there  is  no  guarantee  that  one  can  obtain  a  global  — 
as  opposed  to  local  —  unconstrained  minimizer.  In  fact,  one  can 
show  that  a  sequence  of  unconstrained  local  minimi zers  exists  which 
approach  every  isolated  compact  set  of  local  constrained  minimizers. 
In  the  problem  of  Example  1,  using  a  penalty  function  approach 
would  yield  either  of  the  local  minimizers  depending  upon  the 
initial  starting  point.  The  penalty  function  approach  is  then,  not 
primarily  intended  to  be  a  global  method  in  the  nonconvex  case. 

(It  should  be  noted  that  the  existence  of  a  global  uncon¬ 
strained  minimizer  for  exterior  point  penalty  functions  does  not 
follow  under  the  same  circumstances  and  may  generate  unbounded 
sequences  of  points.) 

METHODS  OF  SUCCESSIVE  FEASIBILITY 

Many  investigators  have  produced  algorithms  for  obtaining 
global  solutions  which  are  variations  of  the  general  idea  of  the 
elimination  of  local  minimizers  once  they  are  obtained  by  the 
addition  of  constraints  which  eliminate  the  local  minimizer. 

Such  an  idea  where  spheres  around  the  local  minimizer  are  intro¬ 
duced  is  contained  in  Hesse  [15] .  As  a  heuristic  such  ideas  might 
have  merit,  but  in  general  there  is  a  great  deal  of  parameter 
selection  necessary  (such  articles  are  full  of  experimentation  with 
e  -  .1,  .001...),  and  as  a  theoretical  device  are  fraught  with 
difficulties.  Two  objections  are  immediate.  In  some  cases  the 
new  constraiut3  introduced  generate  programming  problems  where 
the  local  minimizers  are  not  local  minimizers  of  the  original 
problem.  In  others  such  as  min  f(x)  subject  to 

g  (x)  >  0,  i  =  i, . . .  ,m,  f  (x)  <_  f  (x  )  -  e 
k  i 

where  x  is  a  local  minimizer  previously  found,  the  question  is 
l  '  since  in  a  neighborhood  of  x  there  is  no  point  feasible 
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to  the  problem.  The  problem  of  finding  a  feasible  point  Is  Itself 
an  optimization  problem  and  is  subject  to  the  same  difficulties  as 
the  original  one. 

NGKCGNVEX  QUADRATIC  PROGRAMMING 

The  area  of  finding  global  solutions  to  uot  necessarily 
convex  quadratic  programming  problems  has  an  extensive  literature 
and  will  not  be  discussed  here.  The  first  major  paper  was  pub¬ 
lished  by  Ritter  [30].  Recent  work,  of  Cottle  and  Mylandsr  [31 
explains  and  expands  this  work.  When  the  quadratic  form  (to  be 
minimized)  i?  negative  semi-definite,  the  global  (and  any 
local  solution)  is  at  a  vertex.  Using  this  fact  several  authors 
have  made  suggestions  on  how  best  to  find  it  —  Tui  [35],  Hu  [17], 
Cabot  and  Francis  [2] . 

Other  work  on  the  quadratic  Indefinite  form  has  been  done 
by  Mueller  and  Cooper  [26]. 

GEOMETRIC  PROGRAMMING  AMD  DIFFERENT LABLY  UNIMODAL  FUNCTIONS 

The  class  of  functions  for  which  local  minimization  implies 
global  minimization  is  not  restricted  to  those  where  the  functions 
are  convex.  A  very  general  class  for  which  this  is  true  is  (see 
Mangasarlan  [ 21 J ) 

minimize  f(x)  (a  pseudo  convax  function) 
subject  to  (x)  >_ 0,  i  «  l,...,o  where  each  is  a  quasi 

concave  function).  It  Is  well-known  also  that  Geometric 
Programming  Problems  have  the  local  global  property  evan  though 
the  functions  involved  are  not  pseudo-convex  or  quasi-concave.  In 
a  recent  paper,  Zwart  [39]  showed  for  a  class  of  functions  with 
certain  properties,  local  solutions  are  global  solutions.  His 
classification  covered  the  case  of  geometric  programming.  The 
main  development  Is  repeated  here.  A  function  f  is  a 
differentially  unimodal  function  on  an  open  set  R  if  f  is 
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differentiable  on  R  and  if  when  for  some  point  xeR  Vf(x)  **  0 
holds  it  la  implied  that  x  is  a  global  minimizer  for  f  re¬ 
stricted  to  R  .  (Such  a  point  need  not  exist.) 

Theorem  (Zwart  [39},  p.  157) 

Suppose  that  P  is  a  family  of  functions  for  which  (i) 
fcF  *4  f  is  differentiably  unimodel  en  R  ,  (ii)  feF  -^a  feT 
for  any  positive  real  number  a  ,  and  (iii)  f^eF,  f^eF 

+  f^eF  .  Then  any  problem  of  the  form 

minimize  f(x)  subject  to  g^(x)  >  0,  1  -  l,...,m 

where  f,  {-  g^}eF,  i  «  l,...,m  must  have  the  property  that 

any  local  minimizer  is  a  global  minimizer. 

Analyses  such  as  that  above  may  serve  to  bring  the  special 
characteristics  of  geometric  programming  into  a  synthesis  with 
the  properties  of  convex  programming.  Currently  work  on  obtain¬ 
ing  global  solutions  to  geometric  programming  problems  when  the 
signs  on  the  posynomial  coefficients  are  improper  is  under  way  — 
see  Duffin  and  Peterson  (4]  and  the  references  therein. 


MISCELLANEOUS  METHODS 

Some  interesting  results  on  a  theoretical  level  which  may 
lead  to  procedures  for  obtaining  global  mlnlmizers  have  been 
suggested  in  several  places.  There  is  no  way  to  categorize  these 
except  possibly  to  say  that  they  all  Involve  using  the  integrals 
of  the  objective  function  rather  than  the  derivatives.  Abbre¬ 
viated  summaries  of  these  results  follow. 

Theorem  (Falk  [7]) 

Suppose  the  programming  problem  is 
max  f(x)  (continuous) 

subject  to  xcS  the  closure  of  a  bounded  domain  where  without 

loss  of  generality  it  can  be  assumed  that  f(x)  >  a  >  0  for 

*  “ 

all  xeS  .  Then  a  point  x'  cS  is  not  a  global  minimizing  point 
for  this  problem  if,  for  some  n  >  0  , 
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/  IfCxJ/fCx*)]11*1  >  /  IfCc)/f(x*)]“ 

8  S 

Thaor—  (Falk  {7]) 

A  necessary  and  sufficient  condition  that  a  point  x"*  solve 
the  problem  above  is  that 


“V?  /  uw/fd*)]1  <  -  . 

s 


An  explicit  representation  of  the  point  which  is  the  global 
solution  of  the  above  problem  was  given  by  Pincus  [28] . 


Assume  that  for  the  above  problem,  f  attains  its  global 
minimum  at  exactly  one  point  x* .  Then  the  co-ordinates  of  the 
minimizing  point  are  given  as 


* 


x 


j 


liir 

\-x*- 


If  00 


* 


/  e*f<x) 


THE  BRANCH  AND  BOUND  APPROACH 

Almost  all  optimization  problems  which  can  be  implemented 
on  a  digital  computer  are  capable  of  being  converted  into  equiva¬ 
lent  separable  programming  problems  by  the  addition  of  variables 
and  equality  constraints.  A  method  for  solving  a  nonlinear 
optimization  problem  with  convex  constraints  using  ♦’he  branch  and 
bound  approach  was  suggested  by  Falk  and  Soland  [8]  when  the 
objective  function  was  separable  in  the  nonconvex  portion.  Later 
the  algorithm  was  extended  by  Soland  [33]  to  handle  separable 
nonconvex  constraints. 


Computer  injplernentation  of  the  idea,  which  relies  heavily 
on  the  concept  of  convex  envelopes,  has  been  highly  successful  in 
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certain  cases,  particularly  when  the  subproblems  generated  by 
the  branch  and  bound  algorithm  could  be  handled  by  linear 
programming  subroutines.  A  brief  description  of  the  algorithm 
is  as  follows. 

The  problem  addressed  is 

minimize  f(x)  ■  I ^^f ^  (x^  ) 

subject  to  xeG  (a  closed  set)  , 

XeC  =  {x|£  ^  x  <_  L)  , 

8i^0  -  Ejlli  8ij^Xj^  i  0>  1  "  !>•••>*  • 

For  each  j,  fj  and  all  must  be  lower  semi-continuous  on 

the  finite  interval  [1^ ,  L ^ ] ,  It  is  further  assumed  that  the 

set  of  points  G  AH  is  nonempty  where  H  is  defined  as 
H  =  (xlxeC.g^x)  <^0,  i  »  0,...,m)  . 

These  assumptions  are  enough  to  ensure  that  f  attains  its 
minimum  over  the  set  G/iH  . 

The  algorithm  produces  a  sequence  of  (not  necessarily 

k  k  kVk 

feasible)  points  {x  }  .  Each  x  is  a  solution  of  problem  P 

which  involves  the  minimization  of  a  convex  function  over  the 

intersection  of  G  with  a  convex  set  contained  in  C  .  Branching 

is  the  partitioning  of  C  into  smaller  and  smaller  rectangles, 

and  the  lower  bounds  are  lower  bounds  of  f  over  the  intersection 

of  each  of  these  rectangles  with  GfiH  • 


Crucial  to  the  algorithm  is  the  use  of  convex  envelopes  to 
provide  underestimating  convex  functions  of  the  original  problem 
functions.  Let  CkV  =  {x||2.kv  <_  x  <_  Lkv}  .  In  problem  Pkv  f^  is 

replaced  by  its  convex  envelope  i}*kV  over  [i.kv  ,  Lkv]  ,  and 
each  g  ,  by  its  convex  envelope  0k^  over  ,  Lkv]  . 


10 
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Let 

,  kv,  N  _  „  n  ,kv .  x 

*  GO  =  Sjml  *j  <-xj)  » 

0^(x)  =  Z  ^  9^(x),  i  -  1 , . . . ,m 

lev  lev  lev 

so  that  t)j  is  the  convex  envelope  of  f  over  C  and  0.  is 

kv  1 

the  convex  envelope  of  over  C 

As  a  computational  aside,  it  is  very  simple  to  compute  the 
Uonvex  envelope  of  a  simple  function  of  a  single  variable  over 
an  interval  in  most  practical  cases.  For  example,  if  the  function 
is  concave,  its  convex  envelope  is  a  straight  line.  The  process 
can  be  implemented  on  a  computer  so  that  this ' is  an  automatic 

X  •  1 

procedure  for  standard  functions  as  sin(x) ,  -  e  ,  x*  , 

kv 

The  programming  problem  P  associated  with  any  rectangle 
is  then 

minimize 

subject  to 

xeG, 

*eCkv  5  {x|iikv  <*<  Lkv}  , 
kv 

0^  (x)  0 ,  i  •=  1 , . . .  ,m  • 

kv 

By  construction  it  is  easy  to  show  that  x  ,  any  solution  point 

V*v  kv 

to  P  *  is  a  lower  bound  to  f  over  G  f)  ii  DC 


At  any  stage  k  the  original  rectangle  C  has  been  sub¬ 
divided  into  p^  rectangles  which  together  constitute  a 
k  kl  k?k 

partition  P  ■  {C  C  }.  Associated  with  each  rectangle 


,kv 


are  convex  underestimating  envelopes 
„kv 


i*kv)  . 


{0  ^V}  ,  end 

i  * 


kv 


a  programming  problem  P  with  solution  point  x”- .  Attention 
is  focused  on  the  rectangle  whose  objective  funct-on  value  is 
smallest.  That  is,  let  v^  denote  ar  ^feger 
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where 


kv,  kv. 

.  k,  kv 

<l>  (x  ) 


For  simplicity,  let  x 


.  .kv,  kvN  , 

-  min  \p  (x  ),  v  »  • 

V  kv. 

denote  x  .  The  termination  rule  for 


the  algorithm  is  that  if  f  (xk)  -  iji  k(xk) ,  and  if  xk  e  H  »  then 

lc 

the  problem  is  solved  by  x  ,  This  is  true  because 

^kVk(xk)  1  *  ^(x)  <  f  (x) 
for  all  xeGDHDC^  and  v  ■  l,...,p^  •  If 
k  kvk  k  k 

f(x  )  >  t|i  (x  )  and/or  x  i H  the  algorithm  proceeds  to  stage 

kVk 

k  +  1  by  dividing  the  rectangle  C  into  two  or  more  rectangular 
subsets. 


The  branching  part  of  the  algorithm  takes  two  forms  depending 
on  whether  or  not  the  problem  functions  are  continuous  or  merely 
lower-semicontinuous . 


Weak  Branching  Rule 


Choose  any  j  that  maximizes  the  difference 

or 

k  kvk  k 

W  '  3ij  ‘V 


where  i  is  restricted  to  the  infeasible  constraints,  i.e.,  those 
lc 

for  which  g^x  )  >  U.  Then  +  1,  i.e.,  two  new  rectangles 

kvk 

are  formed  by  splitting  C  into  two  parts.  The  bounds  for  both 
new  rectangles  are  the  same  for  all  components  except  the  jth  which 

kVk  k 

in  one  case  has  ,  x*j]  as  its  bounds,  and  in  the  other, 

k  kvk 

lY  h  !  ■ 


1  O  - 
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Strong  Branching  Rule 


F°r  every  j  such  that 
t  kv 

W  '  *  i  >  0 


Sy&j)  -  01;J  (X  )  >  0 


for  those  i  such  that  (x  )  >  0,  divide  the  corresponding 


kv,  kv,  , 
,  k  t  k] 


interval  [l  ”,  L,  into  the  two  intervals  (JL  k,  xkl 
J  J  j  j 


Nots  that  the  strong  branching  rule  in  general  generates  many 
more  new  rectangles  (and  hence  programming  problems  to  be  solved) 
than  the  weak  branching  rule.  Its  use  is  to  be  avoided  if  possible. 
However,  it  may  be  needed  to  guarantee  convergence  of  the  algorithm. 

Two  statements  about  convergence  are  stated  in  the  following  theorems. 

Theorem  —  If  the  strong  branching  rule  Is  used  to  generate  new 
rectangles,  then  any  limit  poiut  of  {xk}  is  a  solution  of  problem  P. 

Theorem  —  If  the  functions  f.tg^  are  continuous,  and  if  the  weak 

branching  rule  is  used  to  generate  the  new  rectangles,  then  every 
limit  point  of  {x‘  }  is  a  solution  of  problem  P. 


More  details,  and  .hUuscrative  examples  are  contained  in  Falk 
and  Soland  [8],  and  Soland  (35].  A  similar  approach  to  the  problem 
using  concepts  of  special  ordered  sets  has  been  proposed  by  Beale 
and  Tomlin  [1],  and  Tomlin  [34],  Their  piece-wise-linear  approxi¬ 
mation  approach  allows  the  use  of  linear  programming  coles  to  solve 
the  sequences  of  subproblems  generated  by  this  branch  and  bound  method. 
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A  general  approach  which  uses  the  Integral  of  the  function 
over  the  feasible  domain  has  been  proposed  by  Graves  and  Whinston  [13] . 
This  proposal  has  elements  of  the  grid  approach  but  with  a  refine¬ 
ment  procedure  for  creating  smaller  rectangles  similar  to  that  of  Falk 
and  Soland  discussed  in  the  previous  section.  Instead  of  choosing 
the  rectangle  with  the  smallest  lower  bound  for  branching,  they 
compute  the  average  value  of  the  function  over  the  region  and  subdi*- 
vide  the  rectangle  with  smallest  average  vdue.  As  the  area  of  the 
nested  rectangle  goes  to  zero,  the  average  value  approaches  the 
value  of  the  limiting  point.  (This  is  an  abbreviated  description 
of  their  more  general  approach.)  They  have  successfully  solved  some 
small  problems.  Difficulties  in  using  this  method  stem  computa¬ 
tionally  from  the  problem  of  computing  the  average  value  (they  give 
several  approximation  schemes  for  this)  and  the  lack  of  a  valid 
convergence  criterion  other  than  an  exhaustive  subdivision  of  all 
the  rectangles. 

SUMMARY 

Almost  all  of  the  algorithms  suggested  for  obtaining  global 
solutions  to  nonconvex  programming  problems  contain  some  aspect 
which  make  their  implementation  impossible,  or  elements  which 
required  a  combinatorially  unacceptable  amount  of  computer  work. 

The  branch  and  bound  approach,  relying  on  use  of  underestimating 
convex  functions  seems  the  most  reasonable  approach  at  this  time. 

The  efficiency  it  offers  depends  upon  how  quickly  the  regions 
which  do  not  contain  the  global  solution  are  eliminated. 

In  many  instances  the  solution  to  a  nonconvex  problem 
obtained  by  an  algorithm  which  obtains  local  minimizers  can  be 
seen  to  be  the  solution.  The  branch  and  bound  method  takes  no 
advantage  of  the  fact  a  good  guess  at  the  soLution  is  available. 

Rather  than  as  an  algorithm  for  solving  the  problem,  one  should 
probably  regard  the  branch  and  bound  algorithm  as  a  verification 
procedure.  Then  it3  use,  which  is  invariably  longer  in  computer 
time  than  an  algorithm  which  directly  trie,’  to  obtain  local  solu¬ 
tions  can  be  made  greater  or  lesser  by  chose  who  formulate  the 
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